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Dear Editor, 

In a recent article, dos Santos et al. have concluded that, for 
patients with acute coronary syndromes, risk scores correlated with 
coronary artery disease severity' . That apparently positive conci usion 
hides the poor performance of those scores to predict obstructive 
coronary artery disease due to two reasons. Firstly, In face of a 
diagnostic situation (presence of coronary artery disease > 50%), the 
clinical focus should be on accuracy. Secondly, association (described 
In the article as correlation) does not ensure accuracy. 

The major focus of that study should have been accuracy 
measures, such as area under the ROC curve, ranging 



from 0.56 to 0.70. Although statistically significant, those 
values Indicate low accuracy from the diagnostic viewpoint. 
Corroborating those findings. In a recently published 
article in this same journal, our group has concluded that 
the degree of association (between scores and coronary 
anatomy) is not sufficient for risk scores to accurately predict 
the results of angiography^ 

The different conclusions from two studies of similar 
findings is due to the perception that statistical significance 
(true association) and clinical relevance (accuracy) do not 
exactly represent the same phenomenon. 
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Reply 

When Santos et aP have concluded that risk scores 
correlate with coronary anatomy, they considered all 
analyses performed: statistical correlation analysis with the 
non-parametric Spearman test^ and the predictive ability 
of those scores to discriminate Individuals who might and 
might not have a coronary artery lesion > 50%, which 
was initially determined by using the non-parametric 
Mann-Whitney test^, and was later assessed by using C 
statistics (area under the ROC curve)'. As shown in the 
results, that study emphasizes both analyses; assessment 
of the existence of a relationship between risk scores and 
coronary anatomy (Table 3)' and the predictive ability of 
the scores to discriminate who might have coronary lesion 
> 50% (Chart 1)\ Thus, the word "correlation" cited in 



the manuscript' was used as the "relationship between risk 
scores and coronary anatomy". 

The TIMI** and GRACE"''' risk scores have not been 
primarily developed to predict coronary lesion, but adverse 
clinical events. Thus, they are not supposed to have a strong 
discriminatory power to assess coronary lesion > 50% or 
any other variable different from the specific clinical events 
of the original model. Nevertheless, they showed an ability 
that cannot be overlooked' to discriminate who will or will 
not have coronary lesion > 50% as follows: TIMI risk score, 
area under the ROC curve = 0.704; hospital GRACE score, 
area under the ROC curve = 0.623; 6-month GRACE score, 
area under the ROC curve = 0.562. 
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It is worth noting that, for the TIMI risk score, the area 
under the ROC curve in the study by Santos et als.^ was 
greater than that for the specific events of the original model 
of development (area under the ROC curve = 0.65)''. 
Similarly, the TIMI risk score, despite its limited predictive 
ability' for adverse clinical events, due to its clinical relevance 
and practicality, is one of the most used models worldwide, 
recommended by national and international guidelines. 



Sincerely, 
Elizabete Silva dos Santos 
Luciano de Figueiredo Aguiar Filho 
Luiz Minuzzo 
Roberta de Souza 
Ari Timerman 
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